Remote Software engineering Jobs · Evaluation Frameworks

Job listings

  • Design and iterate on agent behavior across real, live workflows, including long-horizon, multi-turn agentic tasks.
  • Build and run evaluations against production conditions to measure performance, regressions, and edge cases.
  • Partner with Product and Engineering to ensure agents are steerable, trustworthy, and ready for scale.

Arcadia is a healthcare platform that transforms complex data into trusted intelligence for providers, payers, and life sciences organizations. Backed by Nordic Capital, the company has hundreds of organizational clients and a mission-driven culture focused on improving patient outcomes.

  • Architect and implement a next-generation LLM enrichment pipeline for enterprise knowledge graphs.
  • Design taxonomies, iterate prompts, and build evaluation harnesses for entity classification and metadata generation.
  • Own end-to-end pipeline from Azure OpenAI integration to human-in-the-loop review and documentation.

ArcTouch creates lovable apps, websites, and connected experiences for world-class companies and innovative startups. It is a specialty studio within the award-winning AKQA Group, with a culture that values collaboration, diversity, and building products people love.

Global 6w PTO 26w maternity 26w paternity

  • Work closely with enterprise customers to translate ambiguous business problems into well-framed agentic workflows with clear success criteria.
  • Lead the design, build, and delivery of LLM-powered agents that reason, plan, and act across tools, APIs, and sensitive enterprise data.
  • Own the full product lifecycle from conceptualization through production, flexing into frontend when needed to drive effective solutions.

Cohere is a security-first enterprise AI company building cutting-edge foundation models and end-to-end products for real-world business problems. They are a global team of researchers, engineers, and designers passionate about their craft, with headquarters in Toronto and offices in key cities worldwide.